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1 .  Introduc  tion 

In  this  paper,  we  describe  an  approach  for  the  incorporation 
of  set-up  times  into  an  earlier  stochastic  scheduling  algorithm 
(Kimemia,-  1982,  and  Kimemia  and  Gershwin,  1983)  for  a  Flexible 
Manufacturing  System  (FMS).  As  before,  the  objective  is  to 
develop  a  feedback  law  which  will  respond  to  and  mitigate  the 
effects  of  random,  potentially  disruptive  events. 

This  approach  to  scheduling  differs  from  conventional  mixed 
integer  programming  representations  {Graves,  1981).  In  such 
formulations,  there  are  a  large  number  of  binary  or  integer 
variables  (for  example,  Afentakis,  Gavish,  and  Karmarkar,  1984; 
Karmarkar  and  Schrage,  1985).  These  approaches  model  the  system 
in  detail,  but  their  large  computational  requirements  make  them 
difficult  to  solve  and  interpret,  and  adding  stochastic  phenomena 

does  not  make  them  any  easier.  Maxwell  and  Muckstadt  (1985) 
simplify  the  problem  by  dealing  only  with  reorder  intervals 
(i.e.,  set-up  frequencies)  and  ignoring  capacity  questions.  Ku- 
siak,  Vanelli,  and  Kumar  (1985)  treat  only  the  grouping  problem. 

In  the  work  reported  here  and  in  Kimemia  (1982)  and  Kimemia 

and  Gershwin  (1983),  the  approach  is  to  gain  as  much  information 
as  possible  from  a  continuous  representation  of  the  flow  of 
material  in  the  system.  Only  after  solving  the  continuous  prob¬ 

lem  is  the  detailed  discrete  problem  treated.  The  detailed 
scheduling  problem  is  then  much  easier  than  it  would  be  if  it 
were  treated  without  first  solving  the  continuous  problem. 

In  that  earlier  work,  however,  set-up  times  were  not  consi¬ 
dered.  That  is,  it  was  assumed  that  no  time  or  cost  was  required 

for  changing  tools  or  other  resources  that  are  specific  to  a 

limited  set  of  part  types.  In  reality,  however,  even  a  FMS  has 

limitations  on  its  flexibility.  The  zero-set-up  time  assumption 

may  be  adequate  for  a  small  set  of  parts  comprising  a  family,  but 

not  for  selecting  times  to  change  configurations  so  that  a  new 
family  can  be  produced.  By  configuration  we  mean  a  set  of 

tooling  that  limits  the  FMS  to  doing  operations  on  a  specific 

part  type  or  family  of  part  types.  To  make  parts  that  are  in 

other  families,  the  configuration  must  be  changed. 

In  this  paper,  we  assume  that  there  is  a  non-zero  set-up 

time.  That  is,  some  time  is  required  to  change  the  configuration 

of  the  system  from  making  one  part  type  (or  family  of  part  types) 

to  making  another.  This  is  an  issue  of  practical  importance 
which  arises  in  metal  cutting  systems,  in  which  tool  magazines 

can  hold  only  a  limited  number  of  tools;  printed  circuit  card 
assembly  systems  in  which  each  insertion  machine  can  hold  only  a 
limited  number  of  types  of  electronic  components;  and  VLSI  fabri¬ 
cation,  in  which  furnaces  must  be  cleared  of  each  kind  of  impuri¬ 

ty  before  the  next  kind  of  impurity  can  be  used. 

It  is  not  desirable  to  change  the  configuration  too  often 
because  that  reduces  the  amount  of  time  available  for  productive 
work  and  thus  the  capacity.  On  the  other  hand,  it  is  not  desir- 
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able  to  change  it  too  infrequently,  because  that  will  tend  to 
increase  inventories  and  delays  before  deliveries.  The  major 
innovation  reported  here  is  the  explicit  calculation  of  capacity 
for  scheduling  problems  with  non-zero  set-up  times. 

The  goal  of  the  analysis  is  to  calculate  the  long-term 
average  frequencies  of  set-ups  and  the  average  fraction  of  time 
that  the  system  is  in  each  configuration  (i.e.,  the  fraction  of 
time  it  is  set  up  for  each  part  type  or  family  of  part  types). 

Further  work  at  the  detailed  level  is  required  to  translate  these 
quantities  into  times  at  which  to  perform  set-ups. 

An  essential  element  of  this  analysis  is  the  explicit  recog¬ 
nition  that  different  events  take  place  at  greatly  different  time 

scales,  i.e.,  frequencies.  At  the  higher  level  of  the  scheduling 

hierarchy,  we  calculate  set-up  frequencies,  average  production 
rates,  and  other  long  term  quantities.  The  lower  level  has  the 

responsibility  of  choosing  times  to  perform  set-ups  and  dispatch 
parts  in  a  way  that  agrees  with  the  high  level  rates.  Because 

the  high  level  analysis  has  no  way  of  determining  exactly  when  a 
set-up  will  take  place,  but  instead  only  the  rates  of  set-ups.  it 

is  reasonable  to  use  the  tools  of  probability. 

The  relationship  of  this  work  to  longer  and  shorter  term 

issues  is  described  in  Gershwin  (1986). 

In  Section  2.  we  describe  a  formulation  in  which  the  set-up 
frequency  is  much  less  that  that  of  the  failures  and  repairs  and 

production  operations.  Two  examples  are  worked  out  in  Section  3. 

Section  4  briefly  describes  the  modifications  to  the  analysis 

when  set-up  frequencies  are  comparable  to  repair  and  failure 

frequencies.  We  conclude  in  Section  5. 

2.  Infrequent  Set-Ups 

In  this  section,  we  consider  the  problem  of  devising  a 

feedback  law  for  the  scheduling  of  a  FMS.  We  wish  to  find  the 

optimal  production  rate  for  each  part  type  and  the  frequencies  of 

set-ups.  We  also  seek  the  fraction  of  time  that  the  system 

spends  in  each  configuration. 

Time  Scales 

We  assume  that  set-up  time  is  not  negligible  compared  to 
operation  time.  The  horizon  is  long  enough  so  that  reliability 

behavior  (i.e.,  repairs  and  failures  of  machines)  may  be  replaced 

by  average  machine  efficiency  (or  possibly  by  a  random  variable 
indicating  the  amount  of  material  produced  during  an  interval; 

parts  are  made  often  enough  so  that  part  flow  may  be  approximated 

by  a  continuous  function  of  time;  and  set-ups  occur  very  many 

times  during  the  problem  horizon.  The  problem  may  be  assumed  to 

have  at  least  two  important  time  scales.  The  short  time  scale  is 

that  of  machine  failures  and  repairs  which  is  treated  by  Kimemia 

and  Gershwin  (1983)  and  Gershwin.  Akella,  and  Choong  (1985).  In 

that  time  scale,  the  system  configuration  never  changes  and  so 
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set-ups  never  occur.  Changes  in  configuration  take  place  over 
the  long  time  scale. 

Notation 

S  =  continuous  long  time  scale  index  variable. 

s,^  =  the  time  required  to  change  configuration  from  m  to 
k;  this  is  specified. 

wm  =  the  fraction  of  time  the  system  is  in  configuration  m  [not 
including  time  during  set-ups]-,  this  is  a  decision  variable. 

fmk  =  the  frequency  that  the  configuration  changes  from  m  to  k. 

That  is.  fmk8S  is  the  probability  that  an  observer  sees  the  system 
change  from  configuration  m  to  configuration  k  during  the  inter¬ 
val  (S,  S  ♦  5S);  this  is  a  decision  variable. 

0^  =  the  frequency  that  the  configuration  changes  from  m  to  k 

while  system  is  in  configuration  m.  That  is,  is  the  proba¬ 
bility  that  an  observer  sees  the  system  in  configuration  m  change 

from  configuration  m  to  configuration  k  during  the  interval  (S. 

S  ♦  5S];  this  is  a  decision  variable.  Note  that 

fmk  =  **  wrn  (2.i: 

Basic  Equations  for  Set-up  Times  in  a  Stochastic  Environment 

By  accounting  for  the  total  time  the  system  can  be  in  any 
configuration  or  having  its  configuration  changed,  we  have 

Iw„  *  Ssm,rm,  =  1  .  (2.2 

The  fraction  of  time  wk(S]  that  the  system  is  in  config¬ 
uration  k  at  time  S  satisfies 

wk(S+6S)  =  wk(S)  +  £<J>  wra(S)6S  -  £<J>  wk[S)8S  . 

m*k  m*k 

Then,  in  steady  state. 

w* '  [  ]w‘  •  <2  3 
Interpretation 

Equations  [2.1)-(2.3]  are  similar  to  the  equations  for  the 
steady-state  probability  distribution  of  a  Markov  process  (in 
which  wm  is  analogous  to  the  probability  of  finding  the  system 
in  state  m,  and  <j>mk6S  is  the  probability  of  a  transition 

from  m  to  k  in  an  interval  of  length  5S.)  The  principal  differ¬ 
ence  is  the  set-up  time  term  in  [2.2],  which  prevents  the  proba¬ 
bilities  from  summing  to  unity. 
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In  the  usual  context,  .  is  known.  There  are  then 

rak 

enough  equations  to  determine  wm  (except  in  singular  cases). 

Here,  however,  both  <&mk  and  wm  must  be  determined. 
Additional  information  is  required. 

Production  Requirements.  Capacity  Constraints,  and  Inventory 

Frequent  set-ups  reduce  capacity  and  make  production  re¬ 
quirements  infeasible.  Infrequent  set-ups  increase  cycle  times 
(the  time  a  part  spends  in  the  factory)  and  inventory.  To  de¬ 
scribe  these  issues,  we  must  introduce  additional  notation.  The 

subscript  L  refers  to  long  time  scale  quantities,  to  distinguish 
quantities  here  from  similar  short  term  quantities  in  Kimemia  and 
Gershwin  (1983),  Gershwin,  Akella,  and  Choong  (1985),  and  Akella, 
Choong.  and  Gershwin  (1984). 

Tjjtm)  =  the  time  that  part  type  j  requires  at  machine  i 

while  the  system  is  in  configuration  m;  this  is  specified. 

ufj  =  the  production  rate  of  type  j  parts  while  the  system  is  in 

configuration  m;  this  is  a  decision  variable. 

nmL  =  the  long  time  scale  capacity  set.  The  long  time 
scale  production  rate  vector  satisfies  the  long  time  scale  capa¬ 
city  constraints; 

u{"(S)  €  ii”  =  ^  u  |  Uj>0.  £  7(j(m)  Uj  <  Ea,  ^  (2.4) 

while  the  system  is  in  configuration  m.  Here  c^  refers  to  the 

repair  state  of  machine  i,  and  Ea*  is  the  average  availability 

of  machine  i  over  the  time  scale  treated  here.  This  issue  and 
notation  are  discussed  in  Kimemia  and  Gershwin  (1983)  and 
Gershwin,  Akella,  and  Choong  (1985). 

=  the  long  term  average  demand  for  part  type  j;  this  is 

specified.  In  order  to  satisfy  demand,  we  must  have 

i'J*.  <«  ■  12.5) 

Equation  (2.2)  indicates  that  as  fmk  increases,  wm 

decreases.  If  wm  is  too  small  (i.e.,  if  the  system  does  not 

spend  enough  time  producing),  then  (2.5)  may  not  be  satisfied  for 
any  feasible  u.  Therefore.  (2.5)  imposes  an  upper  limit  on  set¬ 
up  frequency. 

xLj(S)  =■  the  difference  between  cumulative  production  and 
cumulative  demand  for  type  j  at  time  S;  this  is  a  decision  vari¬ 
able. 


The  dynamics  of  x  are 
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*i,  -  <?  -  ■  (2-6) 

where  m(S)  is  the  configuration  at  time  S. 

An  optimization  problem  is  (2.1)-(2.4),  (2.6),  and 

J(xjS))  =  /sg*(xL(s])ds  (2.7) 

where  g  is  a  measure  of  cost  of  surplus  (x  positive)  or  backlog 

(x  negative).  This  is  similar  to  the  problem  in  Kimemia  and 

Gershwin  (1983)  in  which  flow  rates  are  chosen  to  respond  to 

changes  in  machine  repair  states,  rather  than  configurations. 

Implementation-  The  solution  is  u["(S),  w,  and  f  or 

0.  0  indicates  how  frequently  to  change  configurations. 

An  algorithm  must  be  found  to  determine  the  actual  set-up  in¬ 
stants  so  that  the  actual  frequencies  are  as  close  to  this  as 
possible.  One  possible  approach  is  to  follow  the  earlier  Ger¬ 
shwin.  Akella,  and  Choong  (1985)  method  for  the  lower  level. 

Here,  we  let 

Wm(S)  =  wmS  (2.8) 

This  is  the  calculated  amount  of  time  that  the  system  should  have 
been  in  configuration  m  in  (0,S).  Let  WNm(S)  be  the  actual 

amount  of  time  the  system  has  been  in  configuration  m  between 
times  0  and  S.  Change  the  configuration  to  m  whenever 

WNm(S)  <  Wm(S).  (2.8) 

An  alternative  rule  would  be  to  change  set-ups  when  all  the 

Xu  of  the  current  configuration  have  reached  a 
specified  value. 

Relationship  with  earlier  work:  Figure  2.1  shows  the  rela- 
tionship  oT  tfie  work  described  in  this  appendix  with  the  earlier 
(Kimemia  and  Gershwin,  1983)  algorithm.  The  long  term  average 
demand  rate  is  specified,  at  a  still  higher  level.  The 
problem  (2.7)  is  solved  and  the  results  are  used  in  two  ways:  uj" 
is  used  as  the  demand  rate  d  for  the  lower  level  algorithm;  and  0 
and  w  are  used  to  calculate  set-up  frequencies  and  actual  set-up 
times.  When  the  configuration  (m)  and  the  average  demand  rate  d 

are  specified,  the  lower  level  (k-g)  algorithm  can  be  run. 

3.  Examples  with  Infrequent  Set-Ups 

Example  1 

Consider  a  flexible  manufacturing  system  that  makes  three 
part  types  in  two  configurations.  The  system  consists  of  one 

machine  that  has  holders  for  two  different  tools.  In  configura¬ 

tion  1,  the  system  can  make  types  1  and  2;  in  configuration  2.  it 
can  make  types  1  and  3.  It  takes  one  hour  on  the  average  to  do 
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an  operation  on  any  part  (after  reliability  is  taken  into  ac- 
sf,\  count),  so  the  capacity  sets  are; 

For  m=l, 

u}  +  u*  <  1  (3.1 

where  the  superscript  refers  to  the  system  configuration,  and  for 

m=  2, 

uf  +  u2  <  1  .  (3.2 

The  demands  are  dt  =  .3;  dj  =  .2;  d3  =  A  parts  per  hour. 
Instead  of  considering  the  dynamic  optimization  problem,  we  treat 
the  system  in  steady  state.  To  satisfy  demand,  we  must  have 

W1U1  +  W2U2  =  3  ^ 


w2u2  =  A  J 

Because  there  are  only  two  configurations,  and  because  we 
assume  that  the  system  is  in  steady  state,  (2.3)  becomes 

*12W1  =  *21W2  •  [2A 

It  takes  s12  hours  to  change  the  tools  from  configuration  1 
to  2,  and  s21  hours  to  change  back.  The  normalization 
equation  (2.2)  is  then 

w,  ♦  w2  +  s^d^w,  ♦  s21(P21w2  =  1  .  (3.5 

The  last  two  equations  imply  that 

JL 

*12 

W1 =  -\ - 1  - 

*12  +  *21  +  Sl2  +  §21 


w2  =  -j 


zr~  *  *r-  +  S,,  ♦  S,, 

*12  *21  12  21 

Equation  (3.3)  now  becomes 


x  +  x  _  3ri  +  x  +  s  +  s 

*12  *2,  1*12  *21  12  21  J 

£  =  2(XXs'3‘S20 


'.-'-J-  A-'  J-"* -  •  .  •  .  ■  j' 
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From  (3.3). 
Wj  ♦  w2  >  .9 

o  r , 


~  *  <  9(s, 

*12  *21  ‘ 


(3.9) 

(3.10) 

(3.11) 


Instead  of  dealing  with  optimization  problem  (2.7),  we  as¬ 
sume  that  (3.1),  (3.2).  and  (3.11)  are  satisfied  with  equality. 
We  now  have  6  equations  ((3.1).  (3.2),  (3.7),  (3.8),  (3.9), 

(3.11))  in  6  unknowns  (u},  u^,  uf.  u*.  d>12,  <J>21 ).  However,  there  is 

one  redundant  equation  among  them.  The  additional  equation  can 
be  supplied  by  a  simplified  lower  level  model  in  which  we  mini¬ 
mize  an  estimate  of  the  buffer  space  required  due  to  batching. 

The  results  are 


u 


1  _ 
1  ~ 


5 

9 


i 
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The  system's  operation  proceeds  as  follows:  it  may  start  in 

configuration  1.  for  example,  producing  type  1  and  2  pieces 
at  rate  5/9  and  4/9  pieces  per  hour,  respectively.  These 

quantities  are  averages  since  we  have  assumed  that  the  system 
actually  suffers  numerous  repairs  and  failures  while  it  is  in 

each  configuration.  After  about  2/(9(s12  ♦  s21))  hours,  we  start 
changing  over  to  configuration  2.  This  takes  s12 

hours.  Production  starts  up  again  in  configuration  2  in 

which  type  1  and  3  pieces  are  made  at  rates  1/9  and  8/9 

pieces  per  hour.  The  system  stays  in  this  configuration  for 

about  2/(9(s12  +  s21))  hours,  and  then  the  next  changeover  begins. 

It  takes  s21  hours  and  the  system  is  in  configuration  1 
again. 

Note  that  only  the  sum  of  the  set-up  times  s12  +  s21  is 

important  in  this  problem,  and  not  the  individual  times.  As  the 
sum  increases,  set-ups  are  performed  less  often. 

The  decision  of  precisely  when  the  changeover  will  take 
place  is  left  up  to  the  lower  level.  The  quantities  calculated 
here  are  requirements  that  the  lower  level  must  satisfy. 
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Example  2 


Consider  a  machine  that  does  operations  on  three  classes  of 
parts-  finished  (type  1  parts),  semi-finished  (type  2),  and  rough 
(type  3).  The  same  tool  can  be  used  for  any  of  the  parts,  but  it 
is  worn  by  use.  Once  it  is  used  for  semi-finished  operations,  it 

cannot  be  used  for  finished  operations;  and  once  it  is  used  for 
rough  operations,  it  cannot  be  used  for  finished  or  semi-finished 
operations.  Thus,  there  is  no  changeover  time  in  changing  from 
finished  to  semi-finished  or  semi-finished  to  rough  operations, 
since  there  is  no  tool  change  involved.  Any  other  change  does 

cost  some  time.  Assume  that  the  operation  times  and  set-up  times 


and 


non-zero)  are  all  10  minutes. 

Thus 

r  i  /  10-  if  4  =  J 

tTO  =  < 

J  L  co.  otherwise 

(3.12) 

S12  =S13  =  S23  =  ^ 

s2t  =  s31  =  s32  =  10  J 

Assume 

(3.13) 

dt  =  .02 

dj  =  .03  ^  parts  per  minute. 

da  -  -M  J 

(3.14) 

This  implies  that 

0  <  Uj  <  .1  w,ut  =  .02 

0  <  u2  <  .1  and  w2u2  =  .03 

0  <  u3  <  .1  w3u3  =  .04 

(3.15) 

If  we  assume  that  u,  is  always 

at  its  maximum  value, 

then 

w,  =  .2 
w2  =  .3 
w3  =  .4 

(3.16) 

This  implies  that  (2.2)  can  be 

2*21  *  2*3,  *  3*32  *  . 

written 

(3.17) 

Equation  (2.3)  becomes,  in  this  example, 

3<p21  ♦  403l  =  2012  ♦  2013 
20,2  ♦  4032  =  302,  ♦  3023  . 

There  is  a  third  equation  in  (2.3),  but  it  is  implied 
previous  two. 

Instead  of  solving  the  optimization  problem  (2.7),  we 


(3.18) 

(3.19) 
by  the 

make 
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the  following  simplifying  assumption:  on  the  average,  during 

each  period  that  the  system  is  in  configuration  j  (i.e.,  capable 
of  operating  on  type  j  parts),  it  produces  Kdj  type  j  parts. 
Since  the  average  length  of  time  it  is  in  configuration  1  is 


1 


*12  +  *13 

and  the  average  production  rate  in  that 

state 

is  .1,  then 

— - -j-r .  -  .02K  . 

*12  *13 

(3.20) 

Similarly, 

j  T  =  03K 

*21  *23 

(3.21) 

T  T  T  =  04K  . 

*31  +  *32 

(3.22) 

The  solution  is- 

*12  =  '  075 

(3.23) 

*23  =  3*12 

(3.24) 

*31  =  1*12 

(3.25) 

A  ns  3725 

*21  =  05  -  K 

(3.26) 

*13  =  1*21 

(3.27) 

*32  _  4*21 

(3.28) 

in  which 

75  <  K  <  ^ 

so  that  all  quantities  above  are  non-net 
still  not  quite  complete;  the  quantity  1 

jative. 

<  must 

The  solution 
be  determined. 

is 

Interpretation 

The  solution  has  isolated  two  set-up  cycles;  1  -  2  -  3  -  1 
and  2  -  1  -  3  -  2.  The  first  requires  less  set-up  time,  but  the 

second  may  be  preferred  sometimes.  The  system’s  behavior  will  be 
a  mixture  of  the  two  cycles.  The  cycle  to  be  chosen  at  any  time 
may  depend  on  the  amount  of  each  part  type  that  has  been  pro¬ 
duced. 

Other  cycles  are  possible,  such  as  1-2-1.  These  partial 
cycles  are  not  sufficient  by  themselves,  but  they  may  be  selected 
if,  for  example,  the  production  of  type  3  parts  is  in  excess 
compared  with  types  1  and  2. 
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4.  More  Frequent  Set-Ups 

In  Sections  2  and  3,  changes  of  configurations  are  assumed 
to  be  much  less  frequent  that  machine  failures  and  repairs.  In 
cases  where  these  events  occur  at  about  the  same  frequencies,  we 
can  modify  the  definition  of  "configuration"  to  include  failure 
state.  That  is,  m  now  refers  not  only  to  the  kind  of  tooling 
present  at  any  instant,  but  also  the  failure  state  of  the  system. 

It  includes  a  as  defined  by  Kimemia  and  Gershwin  (1983). 

The  equations  of  Section  2  are  largely  unchanged,  but  they 
must  be  interpreted  differently  since  the  time  scale  is  shor¬ 
ter.  Some  components  of  0^  are  specified  quantities:  the 

repair  and  failure  rates  of  some  machines.  The  rest  are  decision 

variables  with  the  same  meanings  as  in  Sections  2  and  3. 

Equation  (2.4)  must  be  modified  as  follows-. 

um  e  nm  =  ^u  |  u,>0,  2  Tjj(m)  Uj  <  oe^m)  ^  (4.1) 

where  ot^m)  is  the  repair  state  of  machine  i  corresponding  to 
configuration  m. 

5  Conclusion 

This  paper  suggests  an  approach  to  incorporating  set-up 
times  into  the  earlier  Kimemia-Gershwin  scheduling  method  for 
unreliable  FMS’s.  It  follows  the  strategy  of  sidestepping  the 

detailed  combinatorial  analysis  that  would  be  required  if  we 
represented  each  set-up  event  and  each  part  explicitly.  Instead, 

we  deal  with  the  rates  of  these  events,  and  this  greatly  reduces 

the  computational  load. 

Future  work  includes  the  development  of  the  lower  level 
algorithms.  These  algorithms  must  carry  out  the  guidelines  cal¬ 
culated  here.  It  also  includes  the  understanding  of  set-up 

cycles  described  in  Example  2.  Other  related  work  is  devising 

strategies  for  assigning  parts  to  families;  that  is,  deciding 
what  will  each  configuration  be  able  to  do.  Finally,  the  widely 
used  concept  of  hierarchical  decomposition  of  scheduling  algo¬ 
rithms  should  be  examined,  so  that  there  is  a  systematic  method 
for  assigning  issues  to  hierarchical  levels. 
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Figure  1.  The  Production 
Algorithm 


*  Kimemia  and  Gershwin  (1983). 
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